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Response of Spiking Neurons to Correlated Inputs 

Ruben Moreno, Jaime de la Rocha, Alfonso RenartQ and Nestor Parga[| 

Departamento de Fisica Teorica, Universidad Autonoma de Madrid, Cantoblanco, 28049 Madrid, Spain. 

The effect of a temporally correlated afferent current on the firing rate of a leaky integrate-and-fire 
(LIF) neuron is studied. This current is characterized in terms of rates, auto and cross-correlations, 
and correlation time scale t c of excitatory and inhibitory inputs. The output rate v ou t is calculated 
in the Fokker-Planck (FP) formalism in the limit of both small and large r c compared to the 
membrane time constant r of the neuron. By simulations we check the analytical results, provide 
an interpolation valid for all t c and study the neuron's response to rapid changes in the correlation 
magnitude. 
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One of the most fundamental questions in neuro- 
science is to understand the way neurons communicate. 
There is growing evidence that temporal correlations 
in the spike emission times play a relevant role in the 
transmission of information (see, e.g. JIJ). Although 
correlations are indeed present throughout cortex [|, 
their functional role is controversial [Q, |(|. A relevant 
issue is how temporal correlations in a population affect 
the response of a postsynaptic neuron. Most of the work 
in this direction has been numerical, and little is known 
even for simple neuron models such as the LIF neuron 
||, fij. A better knowledge of how correlations affect 
the neuron's input-output function would be useful, for 
instance, to study networks of these neurons, where 
correlations are unavoidable. A related issue is the 
speed with which changes in the correlations of inputs 
can be detected by a post-synaptic cell. In this letter 
we study both questions and interpret our results in the 
context of experiments on auditory processing The 
main conclusions are: 1) the neuron's output rate is 
sensitive only to precisely synchronized inputs (r c < r); 
2) the response decreases (increases) with the timescale 
r c for positive (negative) correlations, and increases 
(decreases) with their magnitude a; 3) this increase is 
larger for afferent currents in the fluctuation-dominated 
(balanced) state than for those in the drift-dominated 
(unbalanced) state; 4) the response increases until it 
reaches a saturation value if the magnitude and time 
scale of the correlations are increased simultaneously 
while keeping their ratio fixed; and 5) the neuron 
response to sudden changes in the size of the correlations 
is very fast, regardless of the magnitude of the change. 

The neuron model and Input statistics. The de- 
polarization membrane potential V(t) of a LIF neuron 
evolves from the reset voltage H according to 



V(t) = 



V(t) 



I(t) 



(1) 
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where I(t) is the afferent and r is the membrane time 
constant g. When the input drives the potential to a 
threshold value 0, a spike is emitted and the neuron is 
reset to H, from where it continues integrating the signal 
after a refractory time T re f. The afferent current I(t) is 



N E 



N, 



m = J E - J ' -4) ( 2 ) 



where 0?j represents the time of the fc-th (Z-tli) spike 
from the i-th excitatory (j-th inhibitory) pre-synaptic 
neuron, and Ngm and Je(i) respectively represent the 
number of inputs and size of the post-synaptic potentials 
from the excitatory (inhibitory) afferent populations. We 
work in the limit of infinitely fast post-synaptic currents, 
in which these are represented by delta functions. We 
consider stochastic spike trains with exponential auto- 
correlations with time constant r c 



k,k' 



v p S(t — t') + Up 



F p -1 
2r r 



(3) 



Here p = E, I, and v v and F p are the firing rate and Fano 
factors of the spike counts (for infinitely long time win- 
dows) of the individual trains from population p. Notice 
that if F p = 1 spikes are uncorrelated (Poisson process) 
and that for F p > 1 spikes are positively correlated while 
for F p < 1 they are negatively correlated. A similar ex- 
pression for the autocorrelation of individual spike trains 
has been used in |J in a study of the effect of synaptic 
filters. This problem is technically different from ours 
because those filters integrate out the Dirac delta in the 
correlation (see eq.(||) below). We also consider exponen- 
tial cross-correlations 



C pq {t,t>) = < J2S(t-t^)6(t'-t k /)>-u, 

Ppq y/F p F q \ U-t't 



P"9 



= ^VpVq 



2r r 



(4) 
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between the trains in populations p and q (p,q — 

E,I). The magnitude of the cross-correlations is de- 
termined by the correlation coefficients p pq of the spike 
counts. For simplicity, we consider all correlations in the 
problem to have the same time constant r c . The reason 
why the Fano factors appear in eq. (|J) is that the time 
integral of the cross-correlation has to be zero if one of 
the trains does not have spike count fluctuations. The 
correlation of the total afferent current is: 

C(t,t>) = < (/(<)- < I(t) >)(7(0- < lit') >) > 



= o*8(t ~t') + -^e 



where er^ is a white noise variance and £2 
tribution to the total variance, o~ 2 ^ = 0^, + 
from correlations in the input spike trains: 



(5) 

is the con- 
£2, arising 



a 2 w = J 2 E N E v E + JjN lVl 

£2 = J%N E v E [(F E - l) + f EE {f EE N E - l)F E p EE ] 
+ J$Ni Vi [{Fi - 1) + fuifuN! - l)Fj pii] 
- 2 J E Ji f E ifiEN E Ni ^eUJ \[Fe~F~ipei (6) 

We suppose that only a fraction of presynaptic neu- 
rons can be correlated with each other. The four pa- 
rameters f pq denote the fraction of correlated neurons 
from populations p and q. The input current J(t) is as- 
sumed to be Gaussian, condition which naturally holds 
when the neuron is receiving a large barrage of spikes 
per second ||, each one inducing a membrane depo- 
larization J very small compared to the distance be- 
tween the threshold and reset potentials, i.e., qualita- 
tively (Q^ H ) (1 + fNp) -C 1. Thus, the input can be 
described in terms of the mean p = J E N E v E — JjNiVj, 
the variance crj i the parameter k = y/ t c /t, and the cor- 
relation magnitude a = £2/(7^, Eq]. 



The analytical solution. We express the input current 
I{t) as 



I(t) = p + cr w r](t) 

m 



Z / 2 , s 

— + \ -1® 



(7) 
(8) 



where rj(t) is a white noise random process with unit 
variance, j3 = \/l + a — 1 and z[t) is an auxiliary colored 



) with the same white 
is easy to check that 



random process which obeys eq 
input noise rj(t). Using eqs 
I(t) is exponentially correlated in the stationary regime 
with correlations that read exactly as (|J) . 

Associated to the stochastic diffusion process defined 
by eqs. (jl|, 0, ||), we have the stationary FP equation) 10 



where L u = -§-u 



H 



r\ ( 

ou 

and 



d 2 

d ' 2 u ' 



Besides, V = pr + a wy J^x, 



The function fix, z) is the steady state probability 
density of having the neuron in the state (x, z). The 
key quantity J(z) is the escape probability current. It 
appears in eq.(M) as a source term representing the reset 
effect: whenever the potential V reaches the threshold 
0, it is reset to the value H with a distribution in z that 
is unknown. The particular distribution of z will depend 
on the value of r re f . The escape current must be deter- 
mined consistently using the normalization of the proba- 
bility density, T re fV out + f ^ dx dzf(x, z) = 1, and 

the threshold vanishing condition, /(v20, z) = 0. The 
output firing rate is given by v out — J_ dzJ(z). 

Small t c expansion (t c -C t). In this regime the quan- 
tities k and a are treated as perturbative parameters. 
If we suppose that the correlation time r c is very small 
compared to the refractory time r re f {r re f 3> t c ), the 



escape current can be written as J(z) 



-z 2 /2 



/2tt 

||. We find v out analytically by expanding eq. (j^ in 
powers of k — \J t c / t, and calculating the terms exactly 
for all a = £2/0"^ f° r the zero order, and perturbatively 
in a > up to the first non trivial correction for the first 
order. The obtained firing rate can be written as 



y eff 



(10) 



Here R(t) = 

function, and the rates v e f f and vq are defined as 



e* (1 + erf(t)), where erf(t) is the error 



V eff ~ Tre f 



rrr / dte^ (1 + erf (t)) 

'Heff 



= T re f + VnT / dte 1 (l + crf(t)) (11) 



The effective reset and threshold are defined as 9 



and H, 



H-flT 



eff 



i>o is the mean firing rate of 
Hence, eq.([lO|) 



a LIF neuron driven by white noise 
implies that when r c = the problem is equivalent to 
considering an uncorrelated input with an effective signal 
variance a\$t — + £2- In this case, our solution is 
exact for all a. When t c 7^ 0, the expression is only 
correct for small values of both k and a > 0. Here the 
analytical result applies only when a > 0, but we checked 
by numerical simulations that the same formula for the 
output rate is also valid for a < 0. 

Large t c expansion (t c t). In this limit the per- 
turbative parameter is k~ x . Now the escape probability 
current J(z) must be derived from the FP eq. ([)]). If we 
assume that r re / -C t c , 
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)}f = -tS(x-V2H)J(z) (9) 
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FIG. 1: Theoretical predictions and simulation results for 
v out as a function of r c . Left: a = 0.21 (upper curve) and 
a — —0.19 (lower curve). Top right: same but for larger 
values of r c . Bottom right: the case a — 0.21 for very small 
values of r c . Full lines: interpolations between the small and 
large r c theoretical predictions performed at the interpolat- 
ing time t c inter ~ 14ms. Dashed line: small r c predictions 
from eq.(^oj). Horizontal line: response to white noise activa- 
tion (a = 0). Other parameters are r = 10ms, r re / = 0ms, 
Q = 1 (in arbitrary units), H = 0, fj, = 81.7s -1 , crj, = 2.1s" 1 . 
Although the small r c expansion requires r re / 7^ the simu- 
lation shows that this prediction is good even for zero T re f- 



This expression generates an additional constraint that 
should hold in addition to the conditions defined above. 
Using standard perturbative techniques we find J(z) and 
the mean firing rate, up to 0(k~ 2 ): 

= J I{ 2 + MiRje)-R(H)) z 

" 1 - VQTref 

(z 2 -l)] (13) 
(14) 



C ( (2 + /?)C 
t c /3r c (l - v T re f) 
C 



Vout ="0H 

T c 

2 2r Tv (R(Q) - R(H)) 2 QR(Q) - HR(H) 
6 = ar z/ -= 

1 - VQT re f ^2 

Note that v out converges to Vq when t c ~^> t. 

Results and comparison with numerical simula- 
tions. We have performed numerical simulations of a 
LIF neuron driven by Gaussian exponentially correlated 
input using eqs. (|l],0,|]) with a twofold motivation. First, 
they can be used to check the analytical results given in 
cqs.( |Hi| , |l4| ) and, second, thet can be employed to deter- 
mine higher order terms in the perturbative expansions 
by interpolating the output rate between the regimes of 
low and high r c . The interpolating curves have been 
determined by setting the firing rate in the small corre- 
lation time range (r c < r) as v out — v e ff + A\ ^frZ + Ait c 
where A\ and A2 are unknown functions of a and of the 
neuron and input parameters, while in the large correla- 
tion time limit (r c > r) the expression given in eq.(14), 
v ou t = i/ + C/t c , was used. The functions A\ and A 2 are 
determined by interpolating these two expressions with 



FIG. 2: Theoretical predictions and simulation results for 
Vout/vo as a function of a for the balanced and the unbal- 
anced states. The neuron is much more sensitive to a in 
the balanced regime (full line, fj, = 40s _1 ) than in the un- 
balanced regime (dashed line, /1 = 110s -1 ). In both cases 
a^, = 30s _1 , t c = 1ms and the other parameters are as in 
Fig. ^. With these parameters Vq = 16.9Hz in the balanced 
state and vo = 69.5Hz in the unbalanced state. 



conditions of continuity and derivability at a convenient 
interpolation point T c ^ nter ~ t. Although we have cal- 
culated analytically the function A\ (eq.|l(i|) for small a, 
this procedure takes into account higher order correc- 
tions which match more accurately the observed data for 
larger values of a. Fig. [I] shows an example the good 
agreement between theory and simulations. When pos- 
itive correlations are considered (a > 0), the interpola- 
tion procedure is robust to changes in fi and a^. For 
negative correlations, changing these parameters some- 
times results in lower quality fits. In these cases we have 
added to the expansion in eq. dl4| ) an extra term, so that 
v ut — vq+C /tc+Bi/t 2 . This is used to match at Tdnter 
the small r c regime which is set as v out = v e f f + B2 ^/t~. 

As it can be appreciated in Fig. |l|, the response in- 
creases as t c decreases (at fixed positive a). This cor- 
responds to the intuitive result that positive correla- 
tions between the pre-synaptic events produce a larger 
enhancement in the output firing rate as the temporal 
window over which they occur decreases. We have also 
considered a situation where the correlation magnitude 
increases with t c as a — jt c , for a fixed 7 > 0. Eqs. ( |l0| ) 
and ([u]) suggest that the rate increases and saturates 
as a function of t c , because it depends only on the ra- 
tio a/r c in the long r c limit. We checked this conclusion 
with simulations using the same parameters as in Fig. |l| 
(data not shown). Note, however, that this manipula- 
tion does not isolate the effect of changing the temporal 
range of the correlations, since now a, which depends on 
the pre-synaptic rates, Fano factors, etc, has to increase 
linearly with r c . 

At fixed r c , the rate increases with a, as shown in Fig. 
|2|. The mean current, /1, and the white noise variance, 
crj, , have been chosen so that the afferent current puts the 
neuron either in the fluctuation-dominated or in the drift- 
dominated regime pj. Notice that the response is more 
sensitive to changes in the correlation magnitude (a) in 
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FIG. 3: Trial averages of the transient responses of a LIF 
neuron to changes in the input correlations. Below t = 
the input has only autocorrelations, described by fx = 40s , 
trj], = 19.3s -1 , a = 0.56, and r c = 15ms (representing inde- 
pendent bursty input spike trains with, e.g. ve = Vi = 10Hz, 
N E = 10 4 , Ni = 2.10 3 , F E = 4, Fi = 1, J E = 6.10" 3 , 
Ji = 2.8.10" 2 ). Full lines: quick responses when a is 
suddenly changed at t = to a — 7 (upper curve) and to 
a = 3 (bottom curve) and synchronization occurs in a precise 
way (t c = lms). These two a's (corresponding to differ- 
ent tone frequencies) can be obtained with pee = 0.34 and 
Pee = 0.13 respectively, and in both cases /ee = 5.10 -2 , 
fu = fsi = fiE = 0. Dashed lines: the same as above 
but t c = 15ms after t — 0, in agreement with The re- 
sponses are slower, but still fast in comparison with r. Other 
parameters are as in Fig. ^ Inset: t croa3 , time when the re- 
sponse hits for the first time the value of the stationary rate 
(crosses in the main graph), as a function of a. Upper curve: 
t c = 15ms, bottom curve: r c — lms. 

the balanced than in the unbalanced state, in agreement 
with the findings in Q| for similar neuron models. 

We can also infer how fast a LIF neuron responds to 
changes in the correlation magnitude a at fixed afferent 
mean current and white noise variance a^. It is easy to 
verify that the instantaneous rate for the time dependent 
FP equation can be expressed as (for the sake of clarity 
we have come back to the physical quantity V and used 
its distribution P(V, z, t)) 

a 2 (t) d r°° 
»out(t) = -^f+— J dzP(V 7 z 7 t)\ v=e (15) 



As we have seen, the exact solution for r c = corresponds 
to a renormalization of er^ to <\.tt ■ This gives v out (i) = 

— ^ — Jjy J dzP(V, z,t)\v=e- Now it is clear that any 
change in a\ff will produce an immediate change in v out 
pl[ . This means that when r c = 0, changes in both cor- 
relation magnitude (a) and white noise variance (cr^) will 
be felt immediately by the firing response of the neuron. 
By analyticity arguments, the response under changes in 
a will be also fast for non-zero, small r c . 

These predictions have been tested with numerical sim- 
ulations in the context of the experimental results found 
in ||. In this experiment, neurons in primary auditory 
cortex (AI) are recorded under stimulation by a pure 
tone. After the stimulus onset, a change in the cross- 
correlogram is observed while the rate changes very little. 
The results shown in Fig. || correspond to the response 
of a LIF neuron integrating a current which emulates the 
activity in AI. The input initially contains autocorrela- 
tions but not cross-correlations and the output rate is 
low. When at t — a tone is presented, there is a sudden 
increase in a (due to a synchronization of a subpopula- 
tion in AI, which depends on the tone frequency). The 
neuron responds by firing at a higher output rate. As ex- 
pected from Fig. |^, this final rate increases with a, but 
the velocity of the response is independent of it (see in- 
set Fig.||) This means that the reaction is equally fast for 
any stimulation tone. As a consequence of this dynamics, 
the correlation coding present in AI is transformed into 
a rate coding by the postsynaptic neuron. 

In || the same synchrony reading problem was dis- 
cussed with AI cells making depressing synapses with the 
reading neuron. The authors show an example where a 
neuron with static synapses fails to respond to the tone. 
We have checked that the results in Fig. || (dashed lines) 
hold for parameter values that can represent the experi- 
mental results. 

Our results could be extended by including the effect of 
finite synaptic time constants t s ; our work takes r s = 
and thus it is the zeroth order in an expansion in this 
parameter. Indeed, we have numerically checked that 
our conclusions hold qualitatively if small, non-zero t s 
(e.g. 2 ms) are considered. 
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